Mobile telephone with improved man machine interface

ABSTRACT

The present invention envisages a GSM mobile telephone in which a line of icons is displayed on a display. As a user navigates through the displayed line of icons, the positions of the icons alter so that the selectable icon moves to the head of the line. This approach makes it very clear (i) which icon is selectable at any time and (ii) where that icon sits in relation to other icons at the same functional level (e.g. only first level icons will be present in one line). First level icons typically relate to the following functions: phonebook; messages; call register; counters; call diversion; telephone settings; network details; voice mail and IrDA activation.

This application is a divisional of U.S. patent application Ser. No.11/646,356 filed Dec. 28, 2006, which is a continuation of applicationno, 10/203,714 filed Mar. 3, 2003, which claims the benefit ofInternational application no. PCT/GB01/00665, filed Feb. 16, 2001.

FIELD OF THE INVENTION

This invention relates to a mobile telephone and in particular to amobile telephone with an improved man machine interface. The term‘mobile telephone’ used in this patent specification should beexpansively construed to cover any kind of mobile device withcommunications capabilities and includes radio telephones, smart phones,communicators, and wireless information devices. It includes devicesable to communicate using not only mobile radio such as GSM or UMTS, butalso any other kind of wireless communications system, such asBluetooth.

DESCRIPTION OF THE PRIOR ART

One of the problems facing the designers of mobile telephone userinterfaces (often called ‘man machine interfaces’ or ‘MMIs’) is how toallow the user to comprehend the internal status of the mobiletelephone. For example, to select or initiate a function (e.g. to openan address book function, enter a PIN security number or to alter thering melody) a user has to understand that the status of the telephoneis such that the function can be selected or initiated. A closelyrelated problem is how to enable a user to confidently alter theinternal status of the phone. This process can be thought of as theproblem of how to enable a user to confidently navigate through thefeature set of the telephone. Because many quite intricate operationshave to be mastered early on for most mobile telephone users (settingsecurity codes, altering ring melodies etc.), it is particularlyimportant to facilitate the task of navigating to and activatingfeatures in the required way.

In addition, mobile telephones offer a very wide (and ever increasing)range of functions. The design of an effective MMI which can be (a)easily navigated by novices yet is (b) flexible enough to enable a largenumber of functions to be included, is a very challenging task. In fact,it is widely acknowledged that few mobile telephone owners regularly useany but the most basic telephone features because current MMIs aredifficult to fully understand. Hence, the technical problem ofeffectively enabling the user to understand the internal status of themobile telephone has to date been inadequately addressed.

One of the reasons why many conventional MMIs are inadequate is thatmobile telephones are small handheld devices which generally includesmall display screens. The size of display screens, even for PDA typedevices, is far too small to handle a rich and effective MMI, such asthe Apple Macintosh Operating System MMI. As a consequence, MMIdesigners have tended to use text based MMIs, even though thesuperiority of graphical user interfaces has long been accepted in thedesktop computing environment.

Conventionally, the small display size has also meant that severalhierarchies of functions have to be offered to a user: the interface canbe thought of as having many layers, with the user having to firstlocate the correct top level function and then, within that function,progressively drill down (sometimes through 3 or more layers) tocomplete the required task. Hence, for example, if a user wishes toenter a new telephone number into an address book stored on the mobilephone, he has to locate a top level function, typically called ‘AddressBook’. He then selects that function and is presented with a list ofsecond level functions relevant to the ‘Address book’ top levelfunction. These second level functions typically include options forreading the contents of the Address Book, entering a new number andpassword protecting access to the address book. Say the user selects theoption for entering a new number; he then is presented with a thirdlevel screen display asking him to complete various fields with thecontact information.

With pure text based, multi-level MMIs, it can be very difficult forusers to build up an understanding of the structure of the MMI; withoutunderstanding, it is very difficult to navigate extensively.

Very recently, some manufacturers have introduced GSM mobile telephoneswhich are beginning to move away from the text only MMI. For example,the Philips Xenium telephone can display several icons on screen: Nokiaand Mitsubishi have GSM telephones which can display one icon on ascreen at a time. Reference may also be made to some PC operatingsystems and applications, in which a contextual help system is used:when the user places the mouse arrow over an icon, folder etc. for morethan a couple of seconds, a help call-out or balloon appears with anexplanation of the function of the icon, folder etc.

It is particularly important that the physical device(s) used to controlnavigation are not only easy to operate but also that the way in whichthey are controlled intuitively matches up with the navigation tasks tobe accomplished. Conventionally, these navigation devices are 4 separatebuttons (for example, for Up, Down, Accept and Reject). A user has tocarefully select the correct button. That generally means that the userhas to take his eyes off the screen. In some devices, a single rockerswitch will overlie 4 separate buttons. But rocker switches can alsorequire a user to take his eyes off the screen and instead concentrateon selecting and using the navigation button correctly. That in turnmakes it far harder, especially for the inexperienced user, to followand concentrate on the MMI. Where the MMI is difficult to follow anyway(as with text based, multi-level conventional GSM telephones, forexample), navigation devices which require a user to take his eyes offthe screen can be difficult to use.

STATEMENT OF THE INVENTION

In accordance with a first aspect of the present invention, a mobiletelephone comprises:

(i) computing means for storing representations of one or more icons;and a

(ii) display operable to be controlled by the computing means to displayone or more icons;

characterised in that the display is operable to show an array ofseveral icons, the arrangement of the array altering as a user navigatesthrough the array in a manner that visually indicates that the status ofthe computing means is such that the function associated with a singleicon can be selected or initiated.

Typically, there will be an array which is a linear array of icons. Asingle icon is then distinguishable from the other icons by, forexample, being at a prominent position within the array, such as at oneend or the middle of the array. A circular array is also a possibleoption. The function associated with that single icon can be readilyselected or initiated using a navigation tool such as a joystick. Theicon itself can be thought of as being ‘selectable’. The selectable iconmay also have displayed in proximity to it a word or words describingthe function of the icon to (i) give it even greater prominence and (ii)to make its function explicitly clear.

The icons in the array may be animated so that their positions on thedisplay alter as a user navigates through them. For example, the iconsin the linear array can be animated to appear to move forward along theline of the array as different icons become selectable, i.e. as the usernavigates along the line.

Preferably, selecting an icon in an array causes some or all of theother icons in the array to alter in appearance and/or position. Thealteration may be an animation in which the other icons appear to twistor revolve and turn into different icons. This may act as an indicationthat one is changing levels (e.g. from a top level function to a secondlevel function) and aids understanding of the MMI.

The present invention envisages a GSM mobile telephone embodiment inwhich a line of icons is displayed on a display: one of the icons isclearly selectable by for example being at the head of the line andbeing the only icon with explanatory text associated with it, typicallyin a balloon format. As a user navigates through the displayed line oficons, the identity of the selectable icon changes; this is reflected inthe positions of the icons altering so that the selectable icon moves tothe head of the line. This approach makes it very clear (i) which iconis selectable at any time and (ii) where that icon sits in relation toother icons at the same functional level (e.g. only first level iconswill be present in one line). First level icons typically relate to thefollowing functions: phonebook; messages; call register; counters; calldiversion; telephone settings; network details; tools; voice mail andIrDA activation.

A zoom (i.e. magnification) function is preferably also provided bywhich a user can cause the size of the icon and/or the word or wordsexplaining the function of that icon displayed on the display to bealtered. The zoom function may be controlled by a volume up and a volumedown button.

In one embodiment, the data representing an icon is stored in memory;the same data can be used to display the icon at normal size (typically16.times. 16 pixels) and also at one or more different sizes, such as anextended size (64.times.64). This scalability removes the need to storemultiple representations in memory and therefore saves memory; instead asoftware algorithm alters the displayed size of the icon.

In another aspect, there is provided a mobile telephone comprising:

computing means for storing representations of one or more icons: and a

display operable to be controlled by the computing means to display oneor more icons;

characterised in that the display is operable to show an array ofseveral icons, the appearance and/or position of some or all of theicons in the array altering as a user selects an icon to visuallyindicate that the status of the computing means is changing.

The alteration may be an animation in which some or all of the iconsappear to twist or revolve and turn into different icons.

In a final aspect, there is provided a mobile telephone in which theidle screen alternates with an alert screen, each screen appearing for apre-determined time. This leads to the layout of the idle screen notbeing cluttered with any kind of alert messages: conventionally, analert message will be included together with the idle screen (e.g. ‘1missed call’; ‘You have a SMS’), but that clutters the screen and canobscure important branding information. In the present embodiment, theidle screen is shown for 5 seconds, and then an alert screen for 5seconds if there are any alerts. The screens alternate until the userreads or reviews the alert screen in some way. Accessing the alertscreen can take the user directly to the menu(s) which allow the user torespond to the alert. Hence, if the alert is that a SMS message has comein, once the user has seen that alert screen, is he offered a directroute into reading the message and/or responding to the message.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention will be further described with reference to theaccompanying drawings in which:

FIG. 1 is a plan view of a mobile telephone in accordance with thepresent invention;

FIG. 2 is a side view of a mobile telephone in accordance with thepresent invention;

FIG. 3 is a plan view of the possible movement which a joystick maymake;

FIG. 4 is a screen shot showing a top level screen;

FIG. 5 is a screen shot showing the top level screen displayed when auser navigates down one step through the top level screen functionsshown in FIG. 4;

FIG. 6 is a screen shot showing the second level screen displayed when auser navigates one step deeper into the Phone Book function shown asselected in FIG. 4;

FIG. 7 is a screen shot showing the second level screen displayed when auser navigates down one step through the second level screen functionsshown in FIG. 6 (i.e. down through the Phone Book functions);

FIG. 8 is a screen shot showing the second level screen displayed when auser navigates down one further step through the second level Phone Bookfunctions shown in FIG. 7;

FIG. 9 is a screen shot showing the second level screen displayed when auser navigates up one step through the second level Phone Book functionsshown in FIG. 8;

FIG. 10 is a schematic showing the effect of zooming on icon size;

FIG. 11 is a schematic showing the effect of zooming on menu text size;

FIG. 12 is a schematic showing the effect of zooming on message textsize;

FIG. 13 is a screen shot showing how the idle screen alternates with thealert screen.

DETAILED DESCRIPTION

Referring now to FIG. 1, a GSM mobile telephone is shown generally at 1.It includes the conventional features of a display 2, a start callbutton 4, an end call button 3 and numeric keys indicated generally at6. Start call button 4 is commonly labelled with a green telephonehandset shown off-hook or marked with the word ‘SEND’. End call button 3is commonly labelled with a red telephone handset shown on-hook ormarked with the word ‘END’. In addition, it also includes a joystick 5,which can be more clearly seen in FIG. 2 as comprising a shortcylindrical member up standing from the front face of the telephone 1.As shown in FIG. 3, the joystick can be readily pushed by a user in oneof 4 different directions. Joysticks of this kind are available from ITTCanon (ref. TPA 413G).

The MMI allows fast, intuitive navigation to take place. That is bestappreciated from FIGS. 4 to 9. FIG. 4 is a screen shot showing a toplevel screen; the Phone Book icon is readily understood by a user tohave been reached since it is (a) at the top of its line, (b) is coupledwith the cartoon style call out including the explanatory text ‘PhoneBook’ and (c) no other icons include explanatory text. Hence the user isinformed that the internal status of the telephone is such that PhoneBook functions can be selected. (From a theoretical perspective, themobile telephone can be though of as a state machine; effectivelyrepresenting the actual state to a user and enabling the user to alterthe condition of the state machine is the task of the MMI).

In FIG. 4, the next icon down the line is a telephone with an arrow.This represents the ‘Diversion’ function. To reach the Diversionfunction, the user nudges the joystick down. FIG. 5 shows the result:the Diversion function is shown at the top of the line, accompanied by acall out balloon stating ‘Diversion’. Coupling the downwards nudge ofthe joystick with moving downwards through a line of icons makesnavigation easily understood and readily achieved without any need forthe user to takes his eyes off the display.

Returning to FIG. 1, the Phone Book function can be selected by simplynudging the joystick to the right; this takes the user to the Phone Bookrelated features depicted in FIG. 6—a second level set offunctions/features. The user is going deeper into the levels now, sothat a nudge to the right is a natural way of expressing this movement.Each of the four top level icons appear to twist around through 180degrees when the joystick is nudged to the right. Four icons appear tocontinue twisting around, but these are now icons of the second levelfunctions related to the Phone Book function. These 4 new icons appearto rotate through 180 degrees to yield the FIG. 6 display.

FIG. 6 shows that the ‘Consult’ feature has been reached since theassociated icon plus call out is at the top of the line. The ‘Consult’feature can be selected simply by nudging the joystick to the rightagain. A phone book would then be displayed. If a different Phone Bookfeature is needed, then the user has to navigate down the list of secondlevel Phone Book icons. One nudge down of the joystick takes the user tothe display shown in FIG. 7: the feature ‘Draft’ has now moved to thetop of the line and is accompanied by the call out ‘Draft’. This icon)plus the other icons further down, appear to move up the line. The‘Draft’ function can be readily selected with a nudge to the right. Afurther nudge down however takes the user down the line of Phone Bookfeatures to yield the FIG. 8 display, in which the ‘Own number’ featurehas been reached. Moving up through the second level Phone book featuresis achieved through nudging the joystick up, as shown in FIG. 9.Returning to the top level screen (i.e. as depicted in FIG. 4) isachieved through nudging the joystick to the left.

Appendix 1 shows a more comprehensive list of the icons and/or wordsdisplayed on the display 2 for different levels. It therefore lists thefeatures and functions which can be navigated to and from using thejoystick. As explained above, a nudge to the right takes one down into adeeper level of the system (e.g. across a row from top to second level).The higher level icons twist around to reveal the icons of the lowerlevel functions. Nudging left takes one up a level (e.g. across a rowfrom third level to second level). The lower level icons twist around toreveal the icons of the higher level functions. Nudging down takes onedown through the items at the same level (down a column) that areassociated with the same immediately higher level function. The icons inthe line appear to move upwards. Nudging up takes one up through theitems at the same level (up a column) that are associated with the sameimmediately higher level function. The icons in the line appears to movedownwards.

A zoom function is also provided by which a user can cause the size ofthe icon and/or the word or words explaining the function of that icondisplayed on the display to be altered. The zoom function is controlledby a volume up (FIG. 1, at 7) and a volume down button (FIG. 1, at 8).The user can zoom in and out as shown in FIG. 10; in addition the usercan select that the word or words explaining the function of one or moreicons is/are not displayed (FIG. 10, bottom right). This gives anuncluttered look to the display, which can be more appealing to a moreexperienced user. Also, it liberates screen space for more icons, whichagain can be appealing to more experienced users. Another earlier use ofthe volume controls to control a zoom function may be useful even whereicons are not associated with any kind of explanatory text at all andsuch an embodiment is within the scope of a further aspect of theinvention.

FIG. 10 also shows how icons can be made to overlap, thereby allowingmore icons to fit onto a display without destroying legibility. Thispurely text based implementation is illustrated at FIG. 11 for menunavigation. Zooming is also very useful when reading, text, such as in aSMS message. This is shown in FIG. 12.

Again, the use of the volume controls for zooming is intuitive, removesthe need for additional zoom-specific keys and therefore saves cost andreduces the apparent complexity of the telephone. Arranging for the zoomIn and zoom Out functions to be controlled by the volume keys is alsoattractive since it enables a user to perform a zoom at any stage in thenavigation process (except during a call or in idle, where speaker andringer are respectively managed by these keys). This is particularlyhelpful in enabling an inexperienced user to experiment with andtherefore learn the structure of the navigation system.

The zoom function may alter in dependence on the selected mode orfunction of the mobile telephone to give one or more zoom settingsoptimised for the selected mode or function. For example, when editingtext the zoom can magnify an amount that is most relevant to seeing textclearly (and multiple zoom settings can be provided and accessed throughmultiple nudges of the zoom button). A different zoom amount may beappropriate for zooming into the normal icon based menus, and anotherfor zooming into text only menus. The zoom function works particularlywell with the mobile telephone of the first aspect of the presentinvention.

The data representing an icon is stored in memory; the same data can beused to display the icon at normal size (typically 16.times. 16 pixels)and also at one or more different sizes, such as an extended size(64.times.64) using a software algorithm. This scalability removes theneed to store multiple representations in memory, which is a valuableresource.

FIG. 13 shows the idle screen: the idle screen alternates with an alertscreen, such as a Missed SMS screen, or a Voice Mail screen or a MissedCall Alert. This leads to the layout of the idle screen not beingcluttered with any kind of alert messages: conventionally, an alertmessage will be included together with the idle screen (e.g. 1 missedcall’; ‘You have a SMS’), but that clutters the screen and can obscureimportant branding information. In the present embodiment, the idlescreen is shown for 5 seconds, and then an alert screen for 5 seconds ifthere are any alerts, as illustrated in FIG. 13. The screens alternateuntil the user reads or reviews the alert screen by pressing OK on thejoystick. The phone will then display a static alert screen with oneicon for every pending event (missed call, received SMS, . . . ). InFIG. 13, the alert screen shows the Missed Call icon. This can beaccompanied with the words “Missed Call’.

Accessing the alert screen can take the user directly to the menu(s)which allow the user to respond to the alert. Hence, if the alert isthat a SMS message has come in, once the user has seen that alertscreen, is he offered a direct route into reading the message and/orresponding to the message.

APPENDIX 1 Second level functions Third level functions Fourth levelfunctions Top level (all icons are task (Words only, unless (Words only,unless functions specific) otherwise stated) otherwise stated) PhoneBook Icon + word Open up address book Icon + words ‘Consult’ ‘PhoneBook” Icon + word ‘Draft’ Enter Name Icon + word ‘Own Display Own NumberNumber’ Icon + word Display storage info ‘Capacity’ Icon + word Enterrestriction PIN ‘Restrict’ Icon + word Enter your business ‘BusinessCard’ card details Message Icon + Icon + word ‘Write Create New WriteMessage word “Messages’ Message’ User pre-defined Select a pre-definedmessage Icon + words ‘In List in-coming Box’ messages Icon + words ‘OutList outgoing messages Box’ Icon + words Displays storage info CapacityIcon + word Service Center Message Center Number ‘Settings’ ValidityPeriod Select validity period option Message type Select message type(e.g., fax, email, x400,standard text, telex Delivery Report Select ‘on’or ‘off’ options Reply via same Select ‘on’ or ‘off’ options MelodySelect Melody option Icon + words ‘Cell Receive CB Select cell broadcast‘on’ Broadcast’ or ‘off’ Call Register Icon + words ‘Missed Lists missedcalls Icon+ words Calls’ “Call Register’ Icon + words Lists receivedcalls ‘Received calls’ Icon + words ‘Dialled Lists dialed calls Sendmessage to; Call calls’ number; Forward calls to; Save number; Optionsto select; then takes you to appropriate screen Icon + words ‘Delete’Lists Missed calls, Received calls, Dialled Calls, All calls CountersIcon + Icon + word ‘Time’ Last call; all calls out; Display time countdata word ‘Counters’ all calls in; Clear timers Divert Icon +Unconditional; all Activate; de-activate Voice, fax, data all optionsword ‘Divert’ unanswered; if busy, and status check to select, thentakes you to if no reply; if not phone book to select reachable numberto receive diversions Settings icon + Icon + word List of various word‘Settings’ ‘Language’ language options to select Icon + words ‘AlertIcon + words All cases; number stored; tones’ ‘Melodies’ Number notstored; messages; Alarm to be selected; then gives lists of melodies toselect Icon + words ‘Key On, Off and DTMF tones Tones’ to be selectedIcon + words ‘Deep On or off to be selected Silent’ Icon + words ‘Ringer3 ranges to be selected Volume’ Icon + words ‘Auto On or off to beselected key lock’ Icon + word Change PIN and Enter PIN required‘Security’ Disable PIN options Icon + word ‘Time & Displays time andDate Alter time and date Date’ Icon + word ‘Auto- On of off to beselected answer’ Icon + word ‘Hot Lists hot keys keys’ Icon + wordSelect 1-3 contrast ‘Contrast’ scale Network Icon + Icon + word barringSelect outgoing, incoming, word ‘Network’ ‘Services’ barring passwordCall waiting Activate, de-activate, status check Identification See callID; call incognito; see connected ID; connect incognito; status checkAuto-redial On or off to be selected Change network Preferred networksLists preferred networks Registration mode Lists automatic, manual,force network Demonstration Give a demo of the Icon + word phone“Demonstration’ Tools Icon + word ‘Tools’ IrDA Icon + words ‘IrDAActivation’

1. A mobile telephone comprising: a display; a navigational tool; and agraphical user interface controlling the display based upon signalsreceived from the navigational tool, wherein: the display displays afirst array of selectable icons associated with a first level ofselectable functions, the navigational tool allows a user to select oneof the selectable functions by nudging the navigational tool in a firstdirection to select one icon from the first array of selectable icons,the function of the selected icon is identified textually on the displayand the functions of the remaining selectable icons are not displayed;and a user can navigate from the display of the first array ofselectable icons to a display of a second array of selectable iconsassociated with a second level of selectable functions by nudging thenavigational tool in a second direction that is not collinear with orparallel to the first direction.
 2. The mobile telephone of claim 1,wherein the navigational tool is one of a joystick and a rocker switch.3. The mobile telephone of claim 1, wherein the second direction isapproximately orthogonal to the first direction.
 4. The mobile telephoneof claim 1, wherein the array of selectable icons at the first level ofselectable icons is a linear array.
 5. The mobile telephone of claim 1,wherein the array of selectable icons at the first level of selectableicons is a two-dimensional array.
 6. The mobile telephone of claim 1,wherein the selected icon is animated upon being selected.
 7. The mobiletelephone of claim 1, wherein the array of selectable icons includesicons for selecting a phone book function and a messaging function. 8.The mobile telephone of claim 7, wherein the array of selectable iconsfurther includes icons for selecting at least one of a call registerfunction, a counter function, a call diversion function, a toolsfunction, and a telephone settings function.
 9. The mobile telephone ofclaim 1, wherein the graphical user interface further includes amagnification function that alters the size of the selected icon. 10.The mobile telephone of claim 9, further comprising an input device thatcontrols both a volume of the mobile telephone and the magnificationfunction.
 11. A method for operating a mobile telephone having adisplay, a navigational tool, and a graphical user interface controllingthe display based upon signals received from the navigational tool, themethod comprising: controlling the display using the navigational tool,the navigational tool being in communication with the graphical userinterface; displaying on the display a first array of selectable iconsassociated with a first level of selectable functions on the display;receiving a selection of one of the selectable functions by a nudging ofthe navigational tool in a first direction selecting one of the firstarray of selectable icons; identifying the function of the selected icontextually on the display and not identifying the functions of theremaining selectable icons on the display; and navigating from thedisplay of selectable icons to a display of a second array of selectableicons associated with a second level of selectable functions in responseto receiving a nudging of the navigational tool in a second directionthat is not collinear with or parallel to the first direction.
 12. Themethod of claim 11, wherein the second direction is orthogonal to thefirst direction.
 13. The method of claim 11, further comprisinganimating the selected icon.
 14. The method of claim 11, wherein thefirst level of selectable functions includes a phone book function and amessaging function.
 15. The method of claim 14, wherein the first levelof selectable functions further includes at least one of a call registerfunction, a counter function, a call diversion function, a toolsfunction and a telephone settings function.
 16. A mobile telephonecomprising: a navigational tool and a graphical user interface forcontrolling a display; and a top level screen on the display showing anarray of selectable icons representing a top level of selectablefunctions, the top level screen showing that one of the selectable iconshas been selected, wherein the function of the selected icon isidentified textually on the screen and the functions of the remainingselectable icons are not identified on the screen, and wherein a usercan navigate from the top level of selectable functions by nudging thenavigational tool.
 17. The mobile telephone of claim 16, wherein thearray of selectable icons is a two-dimensional array, and wherein theselected icon can be selected by nudging the navigational tool.
 18. Themobile telephone of claim 16, wherein the top level screen shows an iconrepresenting a phone book and wherein the icon selecting the phone bookis the default selected icon on the top level screen.
 19. The mobiletelephone of claim 18, wherein by nudging the navigational tool, theuser can navigate from the top level of selectable functions to a secondarray of selectable icons representing a second level of selectablefunctions, and wherein the second level of selectable functions belowthe phone book function includes a consult feature allowing a display ofthe phone book entries and a draft feature allowing entry of newentries.
 20. The mobile telephone of claim 16, comprising means formagnifying the selected icon.